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THE  FUNDAMENTAL  CONTINUITY  THEORY  OF 
OPTIMIZATION  ON  A  COMPACT  SPACE  I 

By 

Murat  R.  Sertel 

November  1972  629-72 


Abstract :   Optimizers  on  a  compact  feasible  region  are  abstractly 
specified  and,  as  set-valued  mappings,  are  studied  for  sufficient 
conditions  yielding  them  (as  well  as  certain  associated  maps  and 
certain  restrictions  of  all  these)  continuous,  using  function  space 
methods.   In  particular,  the  study  concerns  the  continuity  of  the 
set  of  optimal  solutions  as  a  function  of  the  three  arguments: 
(i)  objective  function  used,  (ii)  an  incentive  (or  "penalty/reward") 
function  imposed,  and  (iii)  an  abstract  "parameter".   An  interpreta- 
tion of  the  mathematical  apparatus  is  suggested  and  a  brief  game- 
theoretic  illustration  given. 


Thanks  are  due  Miss  Janet  Allen  for  kindly  (and  meticulously)  typing 
what  follows. 
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Notation:   Let  S  and  T  be  topological  spaces.   The  set  of  all  con- 

S 
tinuous  mappings  of  S  into  T  will  be  denoted  by  T  .   Given  B  C  S  and 

W  c  T ,  the  set  { f  e  T^ I  f (B)  C  W}  will  be  denoted  by  (B ,  W) .  (P  (S) 
will  denote  the  power  set  of  S  and  t(S)  will  denote  the  set  of  non- 
empty closed  subsets  of  S.   Given  B  c:  S ,   ^B)  will  denote  the  set 
{A  e  C(S)  I  AC  B}.   Throughout,  R  will  be  a  non-empty  set  equipped 
with  a  total  order  ^  and  a  (Hausdorff)  topology  which  is  at  least  as 
fine  as  the  order  topology. 

Aim:   Given  non-empty  topological  spaces  X  =  X   ^  X„  and  Y,  of  which  X 
is  compact  with  X   (compact  and)  Hausdorff,  in  this  paper  we  seek 
sufficient  conditions  for  the  continuity  of  (a)  the  optimizers 

ex':   R^""^  X  Y^  X  x^  ^  ^(X^) 

defined  by    the   specification 

a'  (u,g,x   )   =    {x      e   X    I    u(x    ,x    ,g(x    ,x   ))    >:  Sup  u(-  ,x    ,g(-  ,x   ))} 

^  1112  12  2  2 

^1 

(ueR^""^,    geY^,    x^eX2) 

[a  specification  which  is  quickly  seen  to  yield  a'  as  being  into  C(X  )], 
or  (b)  of  its  "associate" 

a:   R^""^  X  Y^  -  (P(Xj  ^ 


determined  by  a(u,  g)  (x  )  =  oi'(u,  g,  x  ),  or  (c)  of  the  restrictions 
"'(u,g)  =  «'|{(u,g)}xX^=-^(^>  ^'-'    ^°  ^("'g)>  ^^' 
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'  2 

X 
"u  "   "|{u}xY^-  ~"  ^   ^^1^  ^  of  ex  to  {u}  X  Y^. 

Motivation:   Our  motivation  derives  from  a  desire  to  understand  in 
what  sense  optimization  on  a  compact  space  (X  above)  is  continuous, 
a  question  we  consider  to  be  perhaps  the  fundamental  topological 
question  of  the  theory  of  constrained  optimization. 

XxY 
Interpretation:   The  functions  u  e  R    may  be  called  utility  functions 

or  objective  functions ,  perhaps  the  former  being  preferred  so  as  to 
emphasize  their  merely  ordinal  nature.   These  are  understood  to  be 
representations  of  complete  (i.e.,  "total"  or  "decisive")  transitive 
relations  on  X  x  y.   Concerning  the  existence  of  such  continuous  rep- 
resentations we  refer  the  reader  to  [Debreu,  1954]  and  [Sertel,  1971b]. 

For  the   functions   g  e  Y     we  prefer   the   term  Incentive   function 
[Sertel,    1971a]    to   the   more   restrictive   terms    "payoff   function",    "penalty/ 
reward   function",    etc.     (although  we  use   the   term  "payoff    function"   in   a 
game-theoretic   illustration  below). 

For  R  we  refer  back  to  our  Notation  .   As  to  X  ,  it  plays  the  role 
of  the  familiar  feasible  region.   The  role  of  Y  is  that  the  utility 
functions  u  are  in  general  sensitive,  not  only  to  x  e  X,  but  also  to 
y  e  Y,  so  that  externally  instituted  rules  g  e  Y  may  serve  to  influence 
optimal  behavior,  i.e.,  a'(u,  g,  x  ).   X  may  be  considered  as  an  abstract 
"parameter  space"  in  which  a  point  is  exogenously  determined,  subject  to 
which  optimization  is  to  be  carried  out. 

A  game-theoretic  context  may  serve  to  illustrate.   For  simplicity, 
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consider  a  non-cooperative  two-person  game  in  which  X^  and  X^  are  the 
strategy  spaces  of  players  1  and  2,  respectively.   Then  g  specifies  the 
"payoff"  to  player  1,  for  whom  u  serves  as  generic  utility  function, 
and  a^   determines  the  player  (1)  cc-mpletely:  for  mathematical  purposes, 
we  are  interested  essentially  in  cx^Cg);  x^  ^  p  (x^ )  ,  and  would  study 
how  this  ("reaction  function")  varies  as  g  is  varied,  given  the  "tastes" 
or  "preferences"  as  represented  by  u.   Here  we  also  investigate  how, 
from  the  viewpoint  of  continuity,  ■"■  the  whole  map  a,  as  well  as  its 
associate  a'  and  the  restrictions  listed  under  (c)  above,  behaves. 

Method/Procedure:   The  nature  of  the  investigation  makes  it  natural  to 
proceed  in  the  reverse  order   <(c) ,  (b) ,  (a)>   in  studying  the  con- 
tinuity of  the  maps  listed  above.   We  always  take  the  unner  semi-finite 
topology  on  C(X^)  and  equip  the  function  sppcp..  R^"""^,  Y^  and  C(X   )    ^ 

with  their  respective  compact-onen  topologiP.-. .   First  we  study  a' 

(u,g) 
and  a^  (Theorem  I).   Then  we  turn  to  a'^  in  the  Corollary  to  Theorem  I. 

Finally,  we  study  a  and  a '  in  Theorem  II,  taking  Y  locally  compact. 

Topological  Refresher:   Let  S  and  T  be  topological  spaces.   The 
compact-0£en  topology  on  the  function  space  T^  is  the  one  generated 
by  {(B,  W) I  B  c  S  is  compact  and  W  c  T  is  open}  as  sub-base. 

'^^^   "PPer  semi-finite  topolopy  on   C(T)  is  the  one  generated  by 
{  <W>  1  W  c  T  is  open}  as  sub-base.   A  polnt-to-set  map  ex:   S  ^   C  (T) 
is  said  to  be  upper  semi-continnnn.^  iff  it  is  continuous  when   C  (T)  is 
given  the  upper  semi-finite  topology. ^   It  is  easily  seen  that 
ex:   S  ^   C(T)  is  upper  semi-continuous  iff  the  set  {seS|  a(s)  H  D  ?^  0} 
is  closed  for  every  closed  D  C  T.  [Michael,  1951]. 
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Proposition  1:   Let  X,  Y  and  Z  be  topological  spaces,  of  which  X  is 

/yxY")  X      X 

locally  compact,  and  let  u  e  Z     .   Define  a  map  w  :   Y  ^  Z  by 

X 
writing  co  (g)  =  g  and  g  (x)  =  u(x,  g(x))  for  every  g  e  Y  and  x  e  X. 

Then  w   is  continuous. 

u 

X      X 
Proof:   Giving  Y  and  Z   their  respective  compact-open 

X  X 

topologies,  let  (B,  W)  CZ  be  a  subbaslc  open  set,  and  take  any  g  e  Y 

such  that  00  (g)  e  (B,  W).   Denote  G  =  a)-l((B,  W))  and  H  =  u"l  (W)  .   Thus, 

g  e  G  and,  by  continuity  of  u,  H  C  X  x  Y  is  open.   Hence,  for  every 

b  e  B,  (b,  g(b))  e  H  and  there  exists  an  open  box  nbd  A^  x  V,  C  H  of 

(b,  g(b));  furthermore,  using  continuity  of  g,  we  may  assume  g(A,  )  C  V,  ; 

and,  since  X  is  locally  compact,  we  may  actually  assume  that  A  Is 

relatively  compact  (i.e.,  its  closure  A,  is  compact)  with  g(A^)  C  V, 

and  A^  X  V,  C  H.   Now  {A,  |  b  e  B}  is  an  open  cover  of  (compact)  B, 

affording  a  finite  subcover  {A,  |  1=1,  ...,  m}.   Defining 

1=1    1    1 


we  see  that  A  C  Y     is   a  basic  open  set  with  g   e   A  C  G  ,   showing  that 
G    CI     Y     is   open  and  proving  that  to     is   continuous. 
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Lema_l:   Let  S  and  T  be  compact  spaces,  of  which  S  is  Hauadorff.   Let 

Y:   S  ^  cm    be  a  map  whose  graph  T  =  { (s ,  t)  e  S  x  t|  t  e  y(s)}  Is 
compact.   Then  y   is  upper  semi- continuous. 


Proof;   Let  D  C  T  be  closed.   Then  D  Is  compact,  since  T  is  so.   Since 
S  is  compact,  S  x  D  is  also  compact.   Thus ,  F  O  (S  x  d)  is  compact,  so 
that  its  projection  P  into  S  is  compact.   But  P  is  precisely  the  set 
(s  e   S\    Y(s)  n  D  ^  0};  and,  being  compact  in  the  Hausdorff  space  S, 
P  is  closed.   This  proves  that  y  is  upper  semi-continuous. 


# 


Proposition  2:   Let  X  =  X  x  X  be  a  non-empty  compact  space  with  X 
Hausdorff;  and,  for  every  v  e  R  ,  define  a  (v) :   X^  -*   ^  (X  )  by 

aCv)Cx2)  =  {x^  e  Xj  v(x^-,  x^)  >  Sup  v(.,  x^)}, 

'X 
so  that  V  H-   a(v)  determines  a  map  a  on  R  .   Then 

X  ^ 

(1)   a  maps  R^  into  C(X^)  ^  [i.e.,  for  each  v  e  R^,  a (v)  maps  X^  upper 

semi-continuously  into   C (X  ) ] ;  and 


Proof:   (ad  (1)):   Let  v  e  R  .   For  every  x  e  X  ,  X^  x  {x  }  is  compact, 

so  the  continuous  v  attains  a  supremum  on  a  non-empty  closed  subset, 

specifically  on  aCvXx^)  x   {x  }  c  X  x  {x  },  whereby  a  (v)  (x  )  e  C(Xj), 

and  we  see  that  a(v)  maps  X  into  C  (X  ) .   To  prove  that  a  (v)  :   X  ->■  C(X^) 

is  upper  semi-continuous,  using  Lemma  1,  it  suffices  to  show  that  the 

graph  r  =  { (x  ,  X  )  £  x|  X   e  a (v) (x  ) }  is  compact,  and  this  we  now  do. 

From  the  continuity  of  v  and  compactness  of  X  ,  (it  is  straightforward 

to  show  that)  the  function  v:   X  ->-  R  determined  by  v(x  )  =  Sup  v(*,  x  ) 

X^ 
is  well-defined  and  continuous.   Since  v  and  v  are  continuous   and  their 

range  is  Hausdorff,  their  graphs  T      =    {(x,  r)  e  X  x  r|  r  =  v(x)}  and 

r_  =  { (x  ,  r)  e  X   X  r|  r  =  ^(x  ) },  respectively,  are  closed.   Also,  by 

continuity  of  v  and  compactness  of  X,  v(X)  is  compact.   Thus,  the  closed 

set  K  =  (X^  X  r  )  n  r  CX  X  v(X)  is  compact.   Now  the  projection  of  K 

into  X  is  precisely  the  graph  r,  so  T  is  compact  and,  by  Lemma  1,  (1) 

is  proved. 


(ad  (2)):   Agreeing  on  the  notation  < |  P ,  Q  | >  =  {v  e  R  |  (p,  q)  e 

P  X  Q  =>  v(p)  <  v(q)}  for  subsets  P,  Q  «^X,  first  we  note  that  <|  P, 

Q  |>  c  R  is  open  when  P  and  Q  are  compact  :   <|  P,  Q  |>  is  iust  the 

union   (  U  ((P,  (-  -,  t))  n  (Q,  (t,  +  -))))  U  (  \J        ((P,  (-  -,  i))  n 
teR  (s.,s)eQ 

(Q,  (s,  +  «)))),  where   ^={(s,  s)f;RxR|s.<s  and  there  is  no  t  e  R 


Take  any  compact  non-empty  B  C  X  and  any  non-empty  open  W  C  X^ , 

^2  X 

so  that  (B,  <W>  )  C  C  (X  )    is  a  subbasic  open  set,  and  take  any  v  c  R 

such  that  a(v)  e  (B,  <W»,   Claim  (established  in  the  next  paragraph): 

for  every  b  c  B,  there  is  a  relatively  compact  open  nbd  V(b)  of  b  and  a 

compact  set  K(b)  c  W  such  that  <|  V(b)  x  w*^,  V(b)  x  K(b)  |>,  where 

W*^  =  X  \  W,  is  a  nbd  of  v.   In  that  case,  {V(b)  |  b  e  B}  is  an  open  cover 

of  B  affording  a  finite  subcover  {V(b  ) |  i  =  1,  ...,  m} ,  and  it  follows 

m     _ 
that  G  =  O  <|  V(b.)  x  w'^,  V(b.)  x  K(b  )|>  is  a  nbd  of  v  such  that 

1=1""  I 

a(G)  c:  (B,  <W>  ),  showing  that  a  is  continuous.   To  complete  the  proof, 

we  turn  to  establish  our  claim  above. 

For  each  b  e  B,  v  attains  a  supremum  s(b)  =   Sup  v  on  {b}  x  w,  and 

{b}xW 
(since  W  is  compact)  s^(b)  =   Sup   v  on  {blxw'^,     Now,  for  all  b  e  B, 
{blxw"" 
s^(b)  <  s(b)  holds,  and  there  are  just  two  possibilities:   (i)  R  owns  an 

element  t(b)  such  that  s.(b)  <  t(b)  <  s(b),  and   (ii)  R  owns  no  such 

element.   If   (i)  holds,  define  T  (b)  =  (-  -,  t(b))  and  T*(b)  =  (t(b),  +  -). 

As  these  are  both  open  sets  and  v  continuous,  taking  any  w(b)  e  W  with 

v(b,  w(b))  £  T  (b),  using  (local)  compactness  of  X,  we  may  find  a  relatively 

compact  open  box  nbd  V  (b)  x  u(b)  of  (b ,  w(b))  such  that  (the  closure) 

-         -         -1   *  c 

V^(b)    X    u(b)  C  V   MT    (b)).      As   W     is    compact,   we  may   also   find   a 


relatively  compact  open  nbd  V  (b)  of  b  such  that  V  (b)  x  w'^  C  v"-' (T  (b)). 
Thus,  writing  V(b)  =  V^  (b)  0  V^Cb)  and  K(b)  =  U(b),  <|  V(b)  x  W^, 
V(b)  X  K(b)  |>  is  a  nbd  of  v.   If   (ii)  holds,  define  T^(b)  =  (-  <»,7(b)) 
and  T  (b)  =   (£(b)  +<=°)  ,  and  find  V(b)  and  K(b)  as  in  the  case  of  (i). 
This  completes  the  proof. 


FUNDAMENTAL  CONTINUITY  THEOREM  I ;   Let  X  =  X  x  X  and  Y  be  non-empty 

topological  spaces,  of  which  X  is  compact  with  X  Hausdorff,  and  let 

(XxY)  ^         X 

u  e  R     .   Consider  the  function  a  on  Y  which  determines,  for 

u 

each  g  e  Y"^,  a  (unique)  map   a  Cg)  defined  on  X  by 


\(&)  (x^)  =  {x^  e  X^  I  u(Xj  ,  x^,  g(x^  ,  x^))  >^  Sup  uC  ,  x^,  g(-  ,  x^))}, 

Then 

(1)   a^  maps  Y^  into  C(X  )  ^  [i.e.,  for  each  g  e  Y^,  a  (g)  maps  X^ 
upper  semi- continuously  into  C(X  )];  and 


C2)   a   is  cont] 


Proof:   (ad  (1)):  Let  g  e   x.      By  continuity  of  u,  the  function 
g^  =  "u^^^  defined  in  Proposition  1  is  continuous,  i.e.,  g  e  R  . 
Thus,  Proposition  2(1)  applies,  showing  that  a  (g)  =  a(g  )  e  C(X  ) 
and  (1)  is  proved. 


(ad  (2)):   Proposition  2(2)  shows  that  a  (g)  =  a(g  )  is  continuous 

"X 
in  g  ,  and  from  Proposition  1  we  see  that  g   is  continuous  in  g  (g  c  Y  ) . 

X         ^2 
Thus,  as  the  composition  a  =  a  o  w  :   Y  ->  d?(X  )   ,  a   is  continuous, 
'  ^         u        u  1      u 

as  to  be  shown.   This  completes  the  proof. 
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COROLLARY ;   In  Theorem  I,  the  map  a'  :   Y   x  x 


a'^(B,  x^)  =  a^(g)Cx^)  (g  e  Y^,  x^  e  X^) 

is  continuous  (in  both  arguments  together) . 

Proof:   From  Theorem  I,  we  already  see  that  a'   is  continuous  in  each 
^  u 

argument  (g  e  Y^  and  x  e  X  )  separately.   But  X  is  compact,  hence 
locally  compact,  in  which  case  the  result  is  a  well-known  consequence 
of  the  compact-open  topology  (on  C(X  )   ). 


Lemma  2;  Let  X,  Y  and  Z  be  non-empty  topological  spaces  of  which  X  and 

6  XxY    .X 

Y  are  locally  compact.   Define  the  maps  v':   Z    xy^xX->-Z  and 

y:   Z^''^  X  Y^  ->  z^  by  y'Cu,  g,  x)  =  u(x,  g(x))  and  y(u,  g)(.)  =  y'(u,  g, 

(u  e  Z^'''^,  g  e  Y^,  X  e  X).   Then 


(1)  y'  is  continuous;  and 

(2)  y,  too,  is  continuous, 


Proof;  (ad  (1)):   Take  any  (u,  g,  x)  in  the  domain  of  p', 

and  let  W  C  Z  be  any  open  nbd  of  y'(u,  g,  x) .   Then  (x,  g(x))  e  u"-^  (W)  , 

so  continuity  of  u  yields  an  open  box  nbd  U  x  V  of  (x,  g(x))  with 

U  C  X  and  V  C  Y  such  that  u(U  x  v)  c  W.   As  X  and  Y  are  locally  compact, 

we  may  assume  u(U  x  v)  C  W;  and,  since  g  is  continuous,  we  may  also 

assume  that  g(U)  C  V  c  V.   Now  we  have  N  =  (U  x  V,  W)  x  (u,  V)  x  u  a 

nbd  of  (u,  g,  x)  with  y ' (N)  c  W,  showing  that  y'  is  continuous. 

(ad  (2)):   This  follows  directly  from  (1)  and  the  well-known  fact 

X  7 

that  the  compact-open  topology  on  Z   is  always  splitting. 
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FUNDAMENTAL  CONTINUITY  THEOREM  II;   Let  X  =  X^  x  x  be  a  non-^empty 

compact  space  with  X  Hausdorff ,  and  let  Y  be  a  non-empty  locally 

6  XxY    X 

compact  space.    Consider  the  map  a'  on  R    x  Y  x  X  defined  (with 

reference  to  Theorem  I)  by  a' (u,  g,  x  )  =  a^CgXx^),  and  consider  the 
"associate"  map  a  on  R    x  Y   determined  by  a(u,  g)  =  a  (g) 
(u  e  R^''  ,  g  e  Y^,  x^  e  X^).   Then  a'  is  into  C  (X^ )  and  a  is  into  CCX^)  '^ ., 
and  both  maps 


K^''-'.^.    ca/' 


are  continuous, 


Proof:   In  Lemma  2(2),  set  Z  =  R.   Then  y:   R^  ^  x  Y^  ^  R^  is  continuous. 

X         ^0 
Also,  using  Proposition  2 ,  a:   R  ->  C(Xj)  ^  is  continuous.   Now, 

clearly,  a  =  a  o  y:   R^""^  x  Y^  ^  C  (X^ )  ^  is  continuous  and  a'  is  into 

CiX^).      Since  X   is  compact,  hence  locally  compact,  the  compact-open 
\  7 

topology  on  C(X^)    is  conjoining,   so  a',  too,  is  continuous.   This 

completes  the  proof. 
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Historical  Note :   An  earlier  study  of  the  continuity  of  the  set  of 
optimal  solutions  is  [Dantzig,  Folkman  and  Shapiro,  1967].   It  works 
with  feasible  regions  lying  in  a  metric  space  and  with  objective 
functions  coinciding  with  real-valued  incentive  functions,  and  takes 
the  "parameter  space"  X„  as  singleton,  investigating  the  continuity 
of  the  set  of  optimal  solutions  as  a  function  of  (i)  objective  function 
used  and  (ii)  feasible  region.   Thus,  neither  does  it  contain,  nor  is  it 
contained  in,  the  present  study. 

In  a  paper  following  the  present  and  [Sertel,  1971a],  we  intend 
to  study  the  continuity  of  the  set  of  optimal  solutions  as  a  function 
of  the  feasible  region  as  well.   (The  present  study  extends  a  corrected 
version  of  the  author's  "The  Fundamental  Continuity  Theory  of  Optimiza- 
tion on  a  Compact  Hausdorff  Space",  Alfred  P.  Sloan  School  of  Management, 
Working  Paper  620-72,  October,  1972.) 


14- 


FOOTNOTES 


0.  Our  notation  R  is  intended  to  be  mnemonic  of  the  real  line,  i.e., 
the  set  of  all  real  numbers  taken  with  the  usual  (Euclidean) 
topology,  since  objective  functions  in  the  literature  are  almost 
always  specified  as  real-valued.   (N.B.  The  usual  topology  on  the 
set  of  reals  coincides,  of  course,  with  the  order  topology,  using 
the  natural  order  of  the  reals).   Thus,  the  reader  may  wish  to 
interpret  R,  throughout  this  paper,  as  the  real  line;  mathematically, 
(s)he  is  quite  free  to  do  so. 

1.  A  terminological  warning  may  be  in  order.   For,  according  to  a 
terminology  not  used  here,  a  mapping  into  a  space  of  non-empty 
closed  sets  is  called  "continuous"  iff  it  is  continuous  when  the 
range  space  is  given  its  "finite"  topology  (see  [Michael,  1951]), 
a  topology  finer  than  the  upper  semi-finite.   When  we  are  given 

a  map  of  a  topological  space  into  a  space  of  non-empty  closed  sets 
and  the  topology  on  the  range  is  understood  (e.g.,  to  be  the  upper 
semi-finite) ,  we  feel  free  to  speak  of  the  map  as  continuous   iff 
it  is  so  w.r.t.  the  topology  on  the  domain  and  that  on  the 
range! 

* 

2.  Note  that  a  function  Y  :   S  ->  (f(T)  which  is  singleton-valued 
(i.e.,  such  that,  for  each  s  e  S,  ¥*(s)  is  a  one-element  set) 
is  upper  semi-continuous  iff  the  function  ^ :      S  ->  T,  defined  by 
1'*(s)  =  {'f(s)}   (s  e  S),  is  continuous. 

3.   Denoting  (R  x  pJs  ^  by  < ,  by  (-  «,  s)  we  mean  {r  e  r|  r  <  s} 
and  by  (s_,  +  °°)  we  mean  {re  r|  s^  <  r}. 

4.   Strictly  speaking,  as  made*  clear  in  announcing  our  Aim,  a   is 
on  {u}  xY^  and  a  (g)  =  a'     ..   As  {u}  x Y^  is  homeomorphic  to 


(u,g)' 


Y  ,  our  informality  in  treating  a   as  a  map  on  Y''  should  cause  no 


Y^ 


5.   See,  e.g.,  Theorem  3.1  (2)  on  pp.  261  of  [Dugundji, 


1966] 


Notice  that,  if  Y  is  the  real  line,  it  is  locally  compact.   The 
relevance  of  this  is  that  our  theorem  may  be  applied  in  the  study 
of  optimization  subject  to  real-valued  (e.g.,  monetary)  inceative 
functions,  such  as  in  the  usual  economic  case:   e.g.,  the  case  of 
taxes  or  subsidies,  the  case  of  wages  or  salaries,  and  the  general 
case  of  a  price  system. 

See  §  10  of  Ch.  XII  in  [Dugundji,  1966]. 
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